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(54) Method and apparatus for decoding transform coefficients 



(57) An apparatus is disclosed for decoding a 
stream of previously encoded coefficients including in- 
put means for receiving the stream of encoded coeffi- 
cients; bit plane level monitoring means connected to 
the input means and adapted to monitor a current bit 
plane level from the stream of coefficients; pixel gener- 
ation means interconnected to the input means and the 
bit plane level monitoring means and adapted to utilize 
the current bit plane level for generating output coeffi- 
cient values each having a predetermined size. The bit 
plane level monitoring means can include a finite state 
control machine interconnected to the input means and 
adapted for determining bit plane level changes in the 
coefficient input stream; a counter interconnected to the 
finite state control machine for monitoring a current bit 
plane level; a heap store interconnected to the counter 
and the finite state control machine and adapted store 
bit plane level values for utilization in recursion opera- 
tions by the finite state control machine; and wherein the 
finite state machine acts to decrement the counter upon 
the receipt of a bit level change indicator in the coeffi- 
cient input stream and further to control the reloading of 
the counter upon completion of the recursion opera- 
tions. 
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Description 
Field of Invention 

[0001] The present invention relates to the field of data connpresslon and in particular, discloses an architecture for 
decoding coefficients that, have been constructed as a result of a compression process. The invention also relates to 
a connputer program product, including a computer readable medium having recorded thereon a computer program 
for decoding a bitstream of previously encoded coefficients. 

Background of Invention 

[0002] The field of digital data compression and in particular digital image compression has attracted great interest 
for some time. 

[0003] In the field of digital image compression, many different techniques have been utilized. In particular, one 
popular technique is the JPEG standard, which utilizes the discrete cosine transform to transform standard size blocks 
of an image into corresponding cosine components. In this respect, the higher frequency cosine components are heavily 
quantised so as to assist in obtaining substantial compression factors. The heavy quantisation is an example of a 
"lossy" technique of innage compression. The JPEG standard also provides for the subsequent lossless compression 
of the transformed coefficients. 

[0004] Recently, the field of wavelet transforms has gained great attention as an alternative form of data compression. 
The wavelet transform has been found to be highly suitable in representing data having discontinuities such as sharp 
edges. SuCh discontinuities are often present in image data or the like. 

[0005] Although the preferred embodiments of the present inventbn will be described with reference to the compres- 
sion of image data, it will be readily evident that the preferred embodiment is not limited thereto. For examples of the 
many different applications of Wavelet analysis to signals, reference is made to a survey article entitled "Wavelet 
Analysis" by Bruce et. al. appearing in IEEE Spectrum, October 1996 pages 26 - 35. For a discussion of the different 
applications of wavelets in computer graphics, reference is made to "Wavelets for Computer Graphics", I. Stollinitz et. 
al. published 1996 by Morgan Kaufmann Publishers, Inc. 

[0006] It would be desirable to provide for a form of hardware embodiment of a decoder so as to provide for efficient 
and effective decoding of a series of wavelet coefficients previously encoded in order to substantially increase the 
speed of decoding. 

Aspects of Invention 

[0007] It is an object of the present invention to ameliorate one or more disadvantages of the prior art. 

[0008] According to one aspect of the invention there is provided an apparatus for decoding a stream of previously 

encoded coefficients including: 

input means for receiving said stream of encoded coefficients; 

bit plane level monitoring means connected to said input means and adapted to monitor a current bit plane level 
from said stream of coefficients; 

pixel generation means interconnected to said input means and said bit plane level monitoring means and adapted 
to utilize said current bit plane level for generating output coefficient values each having a predetermined size. 

[0009] According to another aspect of the invention there is provided a method of decoding a bitstream of previously 
encoded coefficients, the method including the fol towing steps: 

(i) inputting the bitstream of encoded coefficients; 

(ii) determining a current bitplane level of bits within said stream; and 

(iii) generating output coefficient values each having a predetermined number of bits utilizing said current bitplane 
level and bit fragments within said bitstream. According to another aspect of the invention there is provided an 
apparatus for decoding a bitstream of previously encoded coefficients, the apparatus including: input means for 
inputting the bitstream of encoded coefficients; 

determination means for determining a current bitplane level of bits within said stream; and 

generation means for generating output coefficient values each having a predetermined number of bits utilizing 

said current bitplane level and bit fragments within said bitstream. 
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[001 0] According to another aspect of the invention there is provided a connputer program product including a com- 
puter readable medium having recorded thereon a computer program tor decoding a bitstream of previously encoded 
coefficients, the computer program product Including: 

s Input means for inputting the bitstream of encoded coefficients; 

detenninatlon means for determining a current bitplane level of bits within said stream; and 

generatbn means for generating output coefficient values each having a predetermined number of bits utilizing 

said current bitplane level and bit fragments within said bitstream. 

10 Brief Description of the Drawings 

[0011] Embodiments of the Invention are described with reference to the drawings, In which: 

Fig. 1 Is a high-level block diagram illustrating the innage representation technique described in the hereln-men- 
IS tloned patent application; 

Fig. 2 is a diagram illustrating partitioning described in the herein-mentioned patent application; 
Fig. 3 Is a flow diagram illustrating the method of representing, or encoding, an Image described In the herein- 
mentioned patent application; 

Fig. 4 Is a detailed flow diagram illustrating the step of coding a region in Fig. 3; 
20 Fig. 5 is a flow diagram Illustrating the method of decoding a coded representation of an Image produced in ac- 

cordance with the method Fig. 3; 

Fig. 6 is a detailed flow diagram Illustrating the step of decoding a region in Fig. 5; 

Figs 7A to 7D are diagrams illustrating the processing of a two-dimensional, elght-coefflclent region In accordance 
with the encoding and decoding method of Figs. 3 to 6; 
ss Fig. 8 Is a block diagram of a general purpose computer; and 

Figs. 9 to 12 are flow diagrams Illustrating an alternate method representing, or encoding, an image described In 
the herein-mentioned patent application; 

Fig. 1 3A Illustrates a fonm of wavelet transform coefficient decoder; 
Fig. 13B illustrates a form of wavelet transform coefficient encoder; 
30 Fig. 14 Illustrates a single level of the discrete wavelet transform process; 

Fig. 15 Illustrates a second level discrete wavelet transform; 
Fig. 16 illustrates a full level discrete wavelet transform of an image; 
Fig. 17 Illustrates the bkxk encoding process of the preferred embodiment; 

Fig. 18 Illustrates one example of a 4 x 4 btock as constructed In accordance with the preferred embodiment; 
3S Fig. 19 Illustrates the encoding methodology used in the preferred embodiment; 

Fig. 20 illustrates the coefficient output process as implemented In the preferred embodiment; 

Fig. 21 is a schematic illustration of the decoder of the preferred embodiment; and 

Fig. 22 Is a flow chart of a method of decoding a bitstream of previously encoded coefficients. 

40 Detailed Description 

[001 2] Where reference is made In any one or more of the accompanying drawings to steps and/or features, which 
have the same reference numerals, those steps and/or features have for the purposes of this description the same 
f unction(s) and/or operatlon(s), unless the contrary intention appears. 
45 [001 3] Before proceeding with a description of the preferred embodiments, a description is given of the innage com- 
pression and decompression method disclosed in EP-A-08558. 

[0014] This method of compression and decompression Is described in the following sections hereinafter entitled 
"1 .0 Overview of SWEET image Compression Method", "1. 1 Encoding Process of First SWEET image Compression 
Method", "1.2 Decoding Process of First SWEET Image Compression Method", "1.3 Two-Dimensionai Example", and 
50 -1.4 Encoding Process of Second SWEET Image Compression Method". 

1 .0 Overview of SWEET Image Compression Methodfs ) 

[0015] A high-level block diagram is Illustrated in Fig. 1 to provide an overview of encoding method. An input image 
55 1 02 is provided to the transform block 1 1 0, which is preferably a linear transform, to produce corresponding transfomn 
coefficients 112. A discrete wavelet transform (DWT) is preferably employed. 

[0016] The two-dimensional DWT of an image is a transform that represents the image using a low frequency ap- 
proximation to the inriage and three high frequency detail components. Conventionally, these components are termed 
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subbands. Each of the four sub-images formed by the DWT is one quarter of the size of the original image. The low 
frequency image contains most of the information about the original image. This information, or energy compaction, 
is the feature of the discrete wavelet transform image subbands that is exploited for Innage compression. 
[0017] The single-level DWT can be applied recursively to the low frequency image, or subband, an arbitrary number 
of times. For example, a three-level DWT of the image is obtained by applying the transform once and then applying 
the DWT to the low subband resulting from the transformation. Thus, this results in 9 detail subbands and one (very) 
low frequency subband. Even after three levels of DWTs, the resulting low frequency subband still contains a significant 
amount of information of the original innage, yet is 64 times smaller (1/4 x 1/4 x 1/4), thereby effecting a factor of 64 in 
compression. 

[001 8] However, other linear transformations for decorrelating image data may be practiced. For example, a discrete 
cosine transform (DCT) can be practiced. The transform coefficients 112, or more specifically the bit sequences rep- 
resenting their values, are then coded by the bit rearrangement block 120 in an efficient fashion to provide the coded 
representation 122. 

[001 9] The decoding process is simply the reverse of this encoding process. The encoded coefficients are decoded 
into the transform coefficients. The (transform domain) image is then inverse transformed to form the original image, 
or some approximation thereof. 

[0020] Before proceeding with a further description of the embodiments, a brief review of terminology used hereinafter 
is provided. For a binary Integer representation of a number, "bit n*or "bit number n' refers to the binary digit n places 
to the left of the least significant bit. For example, assuming an 8-bit binary representation, the decimal number 9 is 
represented as 00001001 , In this number, bit 3 is equal to 1 , while bits 2, 1 , and 0 are equal to 0, 0, and 1 , respectively. 
Furthermore, a transform may be represented as a matrix having coefficients arranged in rows and columns, with each 
coefficient represented by a bit sequence. Conceptually speaking the matrix may be regarded as having three dimen- 
sions; one dimension in the row direction; a second dimension in the column direction and a third dimension in the bit 
sequence direction. A plane in this three-dimensional space, which passes through each bit sequence at the same 
bitnumber, is called a bitptane or bit plane. 

[0021] For transform coding applications, the number of bits per coefficient required to represent the possible range 
of coefficients is determined by the linear transform and the resolution of each pixel (in bits per pixel) in the input image. 
This range of values for each pixel is typically large relative to the values of most of the transform coefficients, and 
thus many coefficients have a large number of leading zeros. For example, the number 9 has four leading zeros in a 
8-bit representation and has 12 leading zeros for a 16-bit representation. The compression method and apparatus 
represents (or codes) these leading zeros, for blocks of coefficients, in an efficient manner. The remaining bits and 
sign of the number are encoded directly without modification. 

[0022] To simplify and the description, the transform coefficients are assumed hereinafter to be represented in an 
unsigned binary integer form, with a single sign bit. That is, the decimal numbers -9 and 9 are represented with the 
same bit sequence, namely 1001, with the former having a sign bit equal to 1 to indk:ate a negative value, and the 
latter having a sign bit equal to 0 to indicate a positive value. The number of leading zeros is determined by the range 
of the transform coefficients. In using an integer representation, the coefficients are implicitly already quantised to the 
nearest integer value, although this is not necessary. Further, for the purpose of compression, any information contained 
in fractional bits is normally ignored. 

[0023] A region includes a set of contiguous image coefficients. The term coefficient is used hereinafter interchange- 
ably with pixel, however, as will be well understood by a person skilled in the art, the fomner is typically used to refer 
to pixels in a transform domain (eg., a DWT domain). 

1.1 Encoding Process of First SWEET Image Compression Method 

[0024] A more detailed description of the first image compression method is provided with reference to Figs. 3 and 4. 
[0025] Fig. 3 is a flow diagram illustrating the first image encoding method. In step 302, processing commences 
using an input image. In step 304, the input image is transformed using a linear transformation, preferably a discrete 
wavelet transform. An initial region is defined to be the whole image. For example, in the case of a three-level DWT 
of the input image, the resulting coefficients consisting of the 10 subbands can be specified as the region. Alternatively 
each subband can be processed separately, setting each initial region to the whole subband in question. 
[0026] In step 306, the most significant bit (msb) of the largest absolute value of the transform coefficients is deter- 
mined and a parameter, maxBitNumben is set to this coefficient value. For example, if the largest transform coefficient 
has a binary value of 00001001 (decimal 9), the parameter maxBitNumber \s set to 3, since the msb is bit number 3. 
Alternatively, the parameter maxBitNumbermay be set to be any value that is larger that the msb of the largest absolute 
value of the transform coefficients. 

[0027] Further, in step 306, a coding parameter, minBitNumbehs set to specify the coded image quality. In particular, 
this coding parameter specifies the precision of every coefficient in the transformed image and can be varied as re- 
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quired. For example, a minBitNumberoi 3 provides a coarser reproduction of the original image than does a value of 1 . 
[0028] Optionally, the technique involves step 308, which provides an output header in the coded representation of 
the input Image. Thus, in a practical implementation, header information is output as part of the coded representation. 
For example, the output header may contain Information about the source image, including the image height and width, 
the number of levels of the DWT, the mean value of the DC subband, the maxBitNumberparameXer, and the minBit- 
Number parameter. 

[0029] Beginning In step 310, each subband of the transformed image is coded separately in steps 312 and 314. 
Each subband Is coded independently, In order from low frequency to high frequency For the DC subband, the mean 
value is removed prior to coding and coded into the header information in step 308. In step 31 2, each subband is coded 
by setting an initial region as the whole subband. In step 314, the region is encoded with the maxBitNumber an6 
minBitNumberas parameters. This provides a hierarchical code, since lower resolution versions of the Image are coded 
into the bit stream before higher resolutions. Processing terminates in step 316. 

[0030] Fig. 4 is a detailed flow diagram of the procedure "Code regionfcurrentBitNumben minBitNumber)" called in 
step 314 of Fig. 3 for coding each region, where maxBttNumber is provided as the currentBitNumber. In step 402, 
processing commences. The Inputs to the region coding process of Fig. 4 include the currentBitNumber and minBit- 
Number parameXeTs. Preferably, the method Is implemented as a recursive technique where the process is able to call 
itself with a selected region or sub-region. However, the process may implemented in a non-recursive manner. 
[0031] In decision block 404, a check is made to determine if the currentBitNumber paramexer is less than the min- 
BitNumber parameter. Othenvise, if decision block 404 returns tme (yes), nothing is done and processing returns to 
the calling procedure in step 406. This condition indicates that every coefficient in the selected region has a msb number 
less than minBitNumber If decision block 404 retums false (no), processing continues at decision block 408. 
[0032] In decision bkx;k 408, a check is made to determine if the selected region is a 1 x 1 pixel. If decision block 
408 returns true (yes), processing continues at step 410. In step 410, the 1 x 1 pixel Is coded. Preferably, this involves 
directly outputting the remaining bits above the minBitNumber in the coded representation. In step 41 2, processing 
retums to the calling procedure. Othenwise, rf decision block 408 retums false (no), the region consists of more than 
one coefficient and processing continues at decision block 414. 

[0033] In decisbn block 414, the selected region is checked to determine if it is significant. That is, the significance 
of the region Is tested. The region Is said to be insignificant if the msb number of each coefficient in the region is less 
than the value of the currentBitNumber parameter. To make the concept of region significance precise, a mathematical 
definition is given in Equation (1 ). At a given bit number, say currentBitNumber = n, the region is said to be insignificant If: 

fo^l<2-.VveH, (1) 

where R denotes the region, and c^- denotes coefficient (i,j) in this region. 

[0034] ff decisran block 414 returns false (no), processing continues at step 416. In step 416, a value of 0 (or first 
token) is output in the coded representation stream, and the currentBitNumber parameter is decremented by 1. That 
is, the next, lower bttplane of the region is selected for processing. Processing then continues at decision block 404, 
where the region is again processed with the parameters currentBitNumber-^ and minBitNumber Othenvise. if decision 
block 414 retums true (yes), that is, the regk>n is significant, processing continues at step 418. 
[0035] In step 418. a value of 1 (or second token) is output in the coded representation stream. In step 420, the 
selected region is partitioned into a predetermined number (preferably, 4) of sub regions using a specified partitioning 
algorithm. The partitioning algorithm used is known to the decoder. 

[0036] In this method, square regions are used. A region is partitioned preferably into 4 equal-sized (square) subre- 
gions. As shown in Fig. 2, the selected region (R) 200 has a size of M x M coefficients and is partitioned into four equal- 
sized subregions 210, 212. 214 and 216. Each of the subregions has a size of N x N, where N is equal to M/2. This is 
not always possible depending on the size and shape of the initial region. If this is not possible, the initial region can 
be partitioned into a number of square regions, each having dimensions that are a power of 2. and encode these 
partrtkjns separately. In any case, this initialization has minimal effect on the overall results if done in an intelligent 
fashion. Alternatively, a different partition may be used that is suitable for a block-based coder. 
[0037] In step 422. each subregion is then coded with the same currentBitNumber and minBitNumber parameters. 
This is preferably done by means of a recursive call to the procedure "Code reg\or](currentBitNumber, minBitNumbet) 
" of Fig. 4. This coding of subregions may be implemented in parallel or sequentially. In the latter case, the processing 
may commence from a low frequency subband to higher frequency subbands in turn. 

[0038] In the coded representation, a transform coefficient is coded by simply outputting the pixel bits from the cur- 
rentBitNumber to the minBitNumber Preferably, a convention is followed whereby the sign is output only if some of 
the coefficient bits were non-zero. For example, if currentBitNumber = 3, minBitNumber = 1. then -9 (00001001) is 
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coded as "1 0 0" followed by a sign bit "1 

1.2 Decoding Process of First SWEET Image Compression Method 



s [0039] Fig. 5 is a flow diagram illustrating a method of decoding the coded representation of an image obtained using 
the process of Figs. 3 and 4. In step 502, processing commences using the coded representation. In step 504. the 
header infomrvation is read from the coded representation to determine the size of the original image, and hence the 
initial region size. Also, information such as maxBitNumber {equa\ to the initial currentBitNumber in the coding process) 
and minBitNumber are input. Further information includes the mean value of the DC subband. 

10 [0040] In step 506, decoding of each subband is commenced by setting the region to the respective subbands in 
turn. In step 508, the selected region is decoded using the maxBitNumber an6 minBttNumberparameters. In step 510, 
the inverse DWT is applied to the decoded selected region. Processing terminates in step 51 2. 
[0041] Fig. 6 is a detailed flow diagram of step 508 of Fig. 5 for decoding each region using procedure call "Decode 
Teg\on{currentBitNumben minBitNumber)", where rmxBitNumber \s provided as the curmntBitNumber. In step 602, 

fs processing commences. The inputs to the region decoding process of Fig. 6 are the currentBttNumber and minBit- 
Number parameters. Again, the method Is preferably implemented as a recursive technique. However, the process 
can be implemented in a non-recursive manner. 

[0042] In decision block 604, a check is made to detemnine if the currentBitNumber is less than the minBitNumber. 
If decision block 804 returns true (yes), processing continues at step 606. where processing returns to the calling 

20 procedure. Othenvise. if decision block 604 returns false (no), processing continues at decision block 608. 

[0043] In decision block 608, a check is made to determine if the selected region has a size of 1 x 1 pixels. If decision 
block 608 retums true (yes), processing continues at step 610. In step 610, the 1 x 1 region is decoded. Processing 
then returns to the calling procedure in step 61 2. If decision block 608 retums false (no), processing continues at step 
614. In step 614, a bit is input from the coded representation. 

2S [0044] In decision block 616, a check Is made to determine if the bit is equal to 1, that is, the input is checked to 
determine if the region is significant. If decision block 616 returns false (no), processing continues at step 618. In step 
618, the currentBitNumber \s decremented, and processing continues at decision block 604. Othe™/ise, if decision 
block 616 returns taie (yes), processing continues at step 620. In step 620, the regrcin Is partitioned into the predeter- 
mined number (preferably, 4) of sub-regions. In step 622, each of the sub-regions is decoded using the currentBitNum- 

30 berand minBitNumber. This is carried out by means of a recursive call to the process illustrated in Fig. 6. In step 624, 
processing returns to the calling procedure. 

[0045] Thus, the bits output from the significance decisions in the encoder instruct the decoder on which path of the 
algorithm to take, thus mimicking the encoder. The pixels, and possible sign, are decoded by simply reading in the 
appropriate number of bits {currentBitNumber Xo minBitNumber ar\6 if some of these are non-zero the sign bit). 

35 

1.3 Two-Dimensional Example 



[0046] The method effectively codes the leading zeros of most transform coefficients, while coding the bits from the 
most significant bit to the predetermined least significant bit, specified by the parameter minBitNumber, and the sign 
simply as is. Thus, the compression method advantageously represents the leading zer6s. This method is very efficient 
in certain situations, namely for coding discrete wavelet transform image coefficients, which typically exhibit a large 
dynamic range. 

A few coefficients typically have very large values, while most have very small values. 

[0047] An example of encoding a two-dimensional region including 4x4 coefficients is described with reference to 
Figs. 7A to 7D. The processing of the 4 x 4 region 700 of Fig. 7A is commenced with the maxBitNumberseX to 7 since 
this is the largest bit number (bitplane) of all of the coefficients: 
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[0048] The minBitNumber \s set to 3, for illustrative purposes. A header is preferably output in the coded represen- 
tation containing the maxBitN umber and minBitNumber The process of coding the region 700 then follows. 
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[0049] At currentBitNumber = 7, a one (1 ) is output since the region 700 is significant with respect to bit number 7 
(see decision blocl< 404, 408, and 414 and step 418 of Fig. 4). The region 700 is then partitioned into four sub-regions 
(see step 420 of Fig. 4): the top left region 71 0, the top right region 71 2, the bottom left region 71 4 and the bottom right 
region 716 of Fig. 7A. Each of the subregions consist of 2 x 2 coefficients. 
5 [0050] The sub-regions 710, 712, 714 and 716 of Fig. 7A are in turn coded in the predefined processing sequence 
shown of Fig. 7B, where a region 750 consists of four sub-regions 750A to 750D. The three arrows illustrated in the 
diagram indicate the order or sequence of processing, that is, top left sub-region 750 A. top right sub-region 750 B, 
bottom left sub-region 750C, and bottom right sub-region 750D, respectively. 

[0051] The sub-region 710 of Fig. 7A is coded first (see step 422 of Fig. 4). For the currentBitNumber equal to 7, a 
10 one ( 1 ) is output in the coded representation. The sub-region 71 0 is then partitioned into four 1 x 1 pixels having decimal 
values 200, 13, -13 and 3. Each of these coefficients is coded by outputting the bits of each coefficient from the cur- 
rentBltNumber = 7 to the minBitNumber = 3 (see decision block 408 and step 410 of Fig. 4). A sign bit is then output 
if required. Thus, the decimal value is 200 is coded as 11001 followed by the sign bit 0. The coefficient value 13 is 
coded as 00001 with a sign bit 0. The coefficient value -1 3 is coded as 00001 with a sign bit 1 . Finally, the coefficient 
IS value 3 is coded as 00000 (without a sign bit). The coded representation of each coefficient includes the two "1 " bits 
preceding the bits of coefficients -200" between the currentBitNumber an6 minBitNumben This completes the coding 
of the top left sub-region 710. The coded output at this state is: 

1 inooi 0 00001000001100000 . 
200 "IT" "T" 

25 [0052] The header information is not shown in the foregoing expression. 

[0053] The top right sub-region 712 is then coded (per Fig. 7B). A zero (0) is output for each of currentBitNumber 
equal to 7, 6, 5, and 4, since the region 712 is insignificant with respect to these bit numbers. A one (1 ) is output at 
currentBitNumber = 3, since this bitplane is significant with respect to bit number 3. The sub-region 712 is partitioned 
into the four 1 x 1 pixels having values -11 , -8. -4 and -3. These decimal values are coded as bit value 1 with sign bit 

30 1 , bit value 1 with sign bit 1 and bit values 0 and 0 without sign bits, respectively. Thus, at this stage, the coded 
representation is as follows: 

111100100000100000110000000001 11 11 0 0 

-11-8-4-3 

[0054] The bottom left sub-region 714 is then encoded. A zero (0) is output for each of currentBitNumber equal to 
7, 6, 5, and 4, since the region 714 is insignificant with respect to these bit numbers. A one (1 ) is output at currentBit- 
40 Number equal to 3, since this bitplane is significant with respect to bit number 3. The sub-region 71 4 is then partitioned 
into four 1x1 pixels having values 8, 1 , 2 and -1. These are coded respectively as binary value 1 with sign bit 0, and 
binary values 0.0 and 0 without sign bits. 

[0055] Finally, the bottom right sub-region 71 6 having values -2, -2, -3, and -3 is coded. A zero (0) is output for each 
of currentBitNumber ~7, 6, 5, 4 and 3 since the sub-region 716 is insignificant with respect to these bit numbers. No 
45 sign bits are output. Thus, the coded representation is as follows: 

1 1 1 1 001 000001 000001 1 0000000001 1111 0000001 1 000000000. 
[0056] The decoder simply mimics the encoding process to reconstruct the region from the coded representation as 
depicted in Fig. 7C. 

[0057] The decoding process can be made "smarter" in a number of ways. One such a "smarter" way is depicted in 
so Fig. 7D. in this case, the magnitude of the non-zero coefficients is each increased by half of 2 to the power of minBit- 
Number This is depicted in Fig. 7D. In this manner, the "smart" decoding processing generally reduces the mean 
square error between the decoded and the original coefficients. Still further, the encoder can alternatively perform this 
(type of) operation, thereby leaving the decoder to use the simplest depicted in Fig. 7C. 

S5 1 .4 Encoding Process of Second SWEET Image Compression Method 

[0058] A coding process according to an alternate method is hereinafter described with reference to Figs. 9 to 12. 
[0059] A discrete wavelet transform of an entire digital image can be performed on a block-by-block basis. The result 
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of the transformation upon each block is a set of coefficients, wliich are essentially equivalent to a set of spatially 
corresponding coefficients of a discrete wavelet transform of the entire image. For example, from a predetermined set 
of coefficients of a DWT for an entire image, a portion or block of the digital image can be reproduced to a specified 
detail. Selecting the predetermined set of coefficients from the frequency domain amounts substantially to representing 

5 the corresponding portion of a digital image (the block) from the spatial domain. A block based DWT of a digital image 
can be performed by decomposing an image into a plurality of blocks and applying the transfomi to each block inde- 
pendently, thereby substantially evaluating those DWT coefficients relevant to the current spatial location. The advan- 
tage of adopting a block-based transform approach is that a block can be subsequently encoded with minimal interactbn 
(substantially Independent) from another block of the image. Block-based techniques are inherently memory localized 

10 and therefore are generally efficient when implemented using computer systems. 

[0080] Fig. 9 is a flow diagram illustrating the block-based encoding process according to the second encoding 
method. Processing commences at step 902. In step 904, a header is output. This information preferably includes the 
image height and width, the block size, the number of levels of the DWT, and two coding parameters maxBitNumber 
and minBitNumber. Optionally, more or less header information may be used depending upon the appllcatbn. 

IS [00S1] The coding parameter marBitNumber can be selected In a variety of ways. If the block DWT is performed on 
all image blocks prior to coding of any of them, the maxBitNumber can be chosen to be the MSB number of the largest 
coefficient across all DWT blocks. For example, if the largest coefficient is 10000001 (decimal value 129), the maxBit- 
Numberls set to 7 since the MSB is bit number 7. Alternatively, a deterministic bound can be used which is determined 
by the transform and the resolution of the input image. For example, with an 8-bit input image (level shifted to 7-bits 

20 plus sign) emd the Haar transform, the largest MSB is bounded by J+7 where J is the number of levels of the DWT. If 
the blocks are small, the selection of this parameter can have a significant effect on compression. In some instances, 
more sophisticated ways of selecting maxBitNumber may be employed. However, this depends upon the specific ap- 
plk^ation. 

[0062] The parameter m/nS/YWu/nber determines the compression ratio versus quality trade off and can be varied. 
2S For example, for nearly orthogonal transforms, a value of 3 provides adequate image quality for 8-bit, grey-scale or 
24-bit, RGB inoages. 

[0063] In step 906, the image is decomposed into blocks (or an image bbck is formed). The image is decomposed 
preferably into overlapping bkjcks. However, non-overlapping blocks may be employed. The block of coefficients can 
be as large as the whole original image, or as small as a block of 8 x 8 coefficients (for a three-level transform). For 
30 low memory applications, a blockthat is as small as possible may be employed. Generally, a block size of 1 6 coefficients 
is sufficient for higher levels of compressran with a three or four level DWT. A block size of 8 x 8 coefficients with a 
three-level DWT can maintain good coding efficiency by employing differential pulse code modulation (DPCM) on the 
DC coefficient of each block. 

[0054] In step 908, each block is level shifted and the transform is performed. Preferably, a DWT is employed. The 
35 image values are level shifted (for example, by 128 for an 8-bit image) to reduce or eliminate any undue mean bias, 
and each spatial block of the image is transformed. For a DWT, usually some knowledge of the block surrounding the 
current block is needed (and similarly for the inverse DWT). although this is not strictly required, 
[0065] In step 910, the block is coded using the maxBitNumber and minBitNumber parameters. Processing termi- 
nates in step 912. 

40 [0066] Step 91 0 for coding a block is illustrated in detail in the flow diagram of Fig. 10. The inputs to the block coding 
process of Fig. 10 include the currentBitNumber ar\6 the minBitNumber parameXets. With reference to step 910 of Fig. 
9, the maxBitNumber \s input as the currentBitNumber parameter. Processing commences in step 1002. In decision 
block 1004, a check is made to determine if the currentBitNumber \s less than the minBitNumber. If decision block 
1004 returns true (yes), processing continues at step 1006. In step 1006, execution retums to the calling process, 

45 thereby indicating that every coefficient in the block has an MSB number less than the minBitNumber. Otherwise, if 
decision block 1004 retums false (no), processing continues at decision block 1008. 

[0067] In decision block 1008, a check is made to determine If a current block is significant. If decision block 1008 
retums false (no), processing continues at step 1010. In step 1010, a zero (0) is output In the coded representation 
and the currentBitNumber \s decremented, that is, the next lower bit plane is selected. Processing then continues at 

so decision block 1004. Otherwise, if decision block 1008 returns true (yes) processing continues at step 1012. 

[0068] Decision blocks 1 004 and 1 008 along with step 1010 enable the process to find the MSB number of the largest 
coefficient in the block. A block is insignificant with respect to the currentBitNumber tl the MSB number of every coef- 
ficient in the block is less than the currentBitNumber. This is repeated until the bitplane of the block is significant or the 
currentBitNumber \s less than the minBitNumber 

ss [0069] In step 1012, a one (1) is output in the coded representation to indicate the bitplane is significant. In step 
1014, the DC subband is coded. In step 101 6, the block detail Is coded using the parameters J, currentBitNumber and 
minBitNumber. In step 1018, execution returns to the calling procedure. Thus, given that the block is significant, steps 
1012, 1014 and 1016 are carried out to use the (generalized) quadtree segmentation to find all coefficients with an 
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MSB number greater than the minBitNumber. If the block is significant, it is partitioned into two "sub-blocks": the DC 
subband coefficients and the block consisting of the remaining coefficients, referred to as the "block detail" for level J 
since it represents the high frequency information about the block of level J at alt tower levels. 
[0070] Step 1 01 4 of Fig. 1 0 for coding the DC subband is illustrated in detail by the flow diagram of Fig. 1 2. That is, 
5 Fig. 1 2 shows the process of coding a subband or sub-block using currentBitNumber and minBitNumber parameters. 
In step 1202. processing commences. In decision block 1204. a check is made to determine if the currentBitNumber 
is less than the minBitNumber. If decision block 1204 returns true (yes), processing continues at step 1206. In step 
1206, execution returns to the calling procedure. Otherwise, iff decision bkxik 1204 returns false (no), processing con- 
tinues at decision block 1208. 

10 [0071] In deciston block 1208 a check is made to determine if the (subband) block size is 1 x 1 pixels. If deciston 
block 1208 returns true (yes), processing continues at step 1210. in step 1210, the 1 x 1 pixel is coded. This involves 
outputting the bits between the currentBitNumber ar\6 the minBitNumber, inclusive, followed by a sign bit if necessary. 
Processing then returns to the calling procedure in step 1212. Olhenwise, if decision block 1208 returns false (no), 
processing continues at decision block 1214. 

IS [0072] In decision block 1 214, a check is made to determine if the (subband) block js significant. If decision block 
1 21 4 returns false (no), processing continues at step 1 21 6. In step 121 6, a zero (0) is output in the coded representation 
and the currentBitNumber is decremented. Processing then continues at decision block 1204. Othenwise, if decision 
block 1214 returns true (yes), processing continues at step 1218. 

[0073] In step 1 21 8, a one (1 ) is output in the coded representation to indicate that the (subband) block is significant. 
20 In step 1220, the (subband) block is partittoned into four sub-blocks. In step 1222. each sub-block is coded using the 
parameters currentBitNumber an6 minBitNumber, by means of a recursive call to the process of Fig. 12. In step 1224, 
execution returns the calling procedure. 

[0074] Thus, in the process of Fig. 12, a subband or sub-block thereof is coded. The largest MSB number is isolated 
as before. If the sub-block consists of only one pixel, it is coded as a single coefficient Otherwise, the currentBitNumber 

2S is decremented and a zero (0) is output in the coded representation until the currentBitNumber \s less than the min- 
BitNumber, or the subband (sub-block) is significant. If the subband (sub-block) is significant, it is partitioned into four 
(as close to equal as possible) sub-block, and these are coded in turn. A single coefficient, for example the DC coef- 
ficient, is encoded by outputting the coefficient bits from the currentBitNumber to the minBitNumber. Again, the sign is 
preferably only output if some of the coefficient bits are non-zero. 

30 [0075] Step 101 6 of Fig. 1 0 for coding btock detail is illustrated by the flow diagram of Fig. 11. In step 1102, processing 
commences. In decision bkxk 1104, a check is made to determine if the currentBitNumber 'is less than the minBitNum- 
ber. If decision block 1104 returns toie (yes), execution returns to the calling procedure in step 1106. Othenwise, if 
decisuDn block 1 1 04 returns false (no), processing continues at decision block 1 1 08. 

[0076] In decisbn block 1108, a check is made to determine if the block (detail) is significant. If decision block 1108 
35 returns false (no), processing continues at step 1 1 1 0. In step 1 1 1 0, a zero (0) is output in the coded representation and 
the currentBitNumber \s decremented. Processing then continues at decision block 1104. Otherwise, if decision block 
1108 returns true (yes), processing continues at step 1112. 

[0077] In step 1112. a one (1 ) is output In the coded representation to indicate that the block (detail) is significant. In 
step 1114, each of the high-low (HL). low-high (LH), and high-high (HH) frequency subbands is coded. The HL, LH, 
40 and HH frequency subbands of each resolution are commonly refenred to as AC subbands. Each of these subbands 
is coded in accordance with the process of Fig. 12. In step 1116, the block detail is coded using the parameters J-1, 
currentBitNumber an6 minBitNumber {\1 the btock detail exists) by means of a recursive call to the process illustrated 
in Fig. 11. Execution returns to the calling procedure in step 1118. 

[0078] Thus, the block detail for level J is processed to first isolate the MSB number of the largest coefficient. This 
45 is done by decrementing the currentBitNumber and outputting zeros until the block is significant. The block is then 
partitioned into the three high frequency subbands at level J and the block detail for level J-1 (if J-1 is greater than 0). 
This partitioning approach is motivated by the so-called 1/ff type spectral nruxJels. 

[0079] The decoding process for the second method can be implemented by mimicking the coding process described 
with reference to Figs. 9 to 12. 

so [0080] The encoding and decoding methods and apparatuses represent digital image data in an efficient and flexible 
manner, in which the representation is suitable for storing and/or transmitting images. The encoding techniques can 
be used generally to represent an array of transform coefficients, and to provide an efficient representation by repre- 
senting an image in the discrete wavelet transform domain. In particular, the methods and apparatuses represent (or 
code) leading zeros of blocks of transform coefficients obtained from an input image. The techniques are efficient in 

55 terms of offering a good reproduction of the original image for a given size code and offering fast decoding. Further, 
the techniques are flexible in that coefficients obtained from a linear transformation are encoded independently without 
the use of entropy coding. The advantageous aspects of the methods include the depth first nature of the coding. 
Further, in the case of coding subbands, the advantageous aspects of the method include hierarchical coding of each 
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subband separatefy. 

2.0 Preferred Embodimentrs) of Apparatus and Method 

[0081] Turning initially to Fig. 13A, there is illustrated a decoder arrangement 1300 of the preferred embodiment. 
The output data 1 310 of the decoder will be a close approximation of the original input data. The output data 1310 is 
a result of inverse wavelet transforming 1308 a series of wavelet coefficients 1306 which are input from a coefficients 
decoder 1 304. The wavelet coefficients 1 306 are obtained from the decoder 1 304 by decoding the encoded coefficients 
1302. 

[0082] The decoder arrangement 1 300 includes a standard inverse wavelet unit 1 308 and a coefficient decoder 1 304 
in accordance with the preferred embodiment. As the decoding process mimics the encoding process, the correspond- 
ing encoding process will now be described in order to fully comprehend the operation of the coefficients decoder 1 300. 
Such an encoder is illustrated in Fig. 1 3B, which involves the inverse of the arrangement shown in Fig. 1 3A. An example 
of the encoding process will be described hereinafter. 

[0083] A description of the wavelet transform process is given in many standard texts and in particular the afore- 
mentbned book by Stollnitz et. al. In order to assist in obtaining a proper understanding of operation of the decoder 
preferred embodiment, an overview of the wavelet process will now be initially described with reference to the accom- 
panying drawings. 

[0084] Referring initially to Fig. 14. an original image 1400 is transformed utilizing a Discrete V\fevelet Transform 
(DWT) into four subimages 1402-1408. The subimages or subbands are normally denoted LL1 , HL1 , LH1 and HH1 . 
The 1 suffix on the subband names indicates level 1. The LL1 subband is a low pass decimated version of the original 
image. 

[0085] The wavelet transform utilized can vary and can include, for example, Haar basis functions. Daubechies basis 
functions etc. 

[0086] The LL1 subband is then in turn utilized and a second Discrete Wavelet Transform is applied as shown in Fig. 
15 giving subbands LL2 (1502), HL2 (1504). LH2 (1506), HH2 (1508). This process is continued for example as illus- 
trated in Fig. 16 wherein the LL4 subband is illustrated, the LL4 band decomposition process being referred to as an 
octave band filter bank with the LL4 subband being referred to as the DC subband. Obviously, further levels of decom- 
position can be provided depending on the size of the input innage. 

[0087] Each single level DWT can in tum be inverted to obtain the original image. Thus a J-level DWT can be inverted 
as a series of J-single level inverse DWTs. 

[0088] A coded image hierarchically can proceed by coding the DC subband. Then, the remaining subbands are 
coded in order of decreasing level. That is for a 4 level DWT, the subbands at level 4 are coded after the DC subband 
(LL4). That is the HL4. LH4 and HH4 subbands. The subbands at level 3 (HL3, LH3, and HH3) are then coded, followed 
by those at level 2 (HL2, LH2 and HH2) and then level 1 (HL1 , LH1 and HH1 ). 

[0089] With standard images, the encoded subbands normally contain the "detail" information or energy information 
in an image. Hence, they often consist of a sparse array of values and substantial compression can be achieved by 
quantisation of the subbands and efficient encoding of their sparse matrix form. 

[0090] Although the present invention has application to image blocks of any size, for ease of description it will be 
assumed that an image eg. 1700 as illustrated in Fig. 17 is broken into 4x 4 blocks 1702 of pixels. An enlarged view 
of the block 1702 is illustrated in Fig. 17a. The 4x4 blocks can then be independently fed to a wavelet transform unit 
1354 of the encoder for wavelet transforming. 

[0091] For most normal images, it is known that the wavelet transform process results in most of the energy or 
significance appearing in the lower frequency coefficients. Turning to Fig. 18. there is shown an example output 1800 
of a standard wavelet process with the coefficients eg. 1802 being shown in a decimal and 8-bit binary format. 
[0092] A coefficient encoder 1 358 is responsible for encoding the coefficients 1 800 of each 4x4 block in an efficient 
form in accordance with the second image compression method as described in the aforementioned section ^1.4 En- 
coding Process of Second SWEET image Compression Method", The coefficient encoder can also be modified, as 
will be apparent to a person skilled in the art, to encode the coefficients of an image in accordance with the first image 
compression method as described in the aforementioned section "1.1 Encoding Process of First SWEET Image Com- 
pression Method" in a similar efficient manner. However, for the purposes of the description, the preferred embodiment 
is described with reference only to the preferred apparatus and method for decoding coefficients encoded according 
to the second image compression method. In the preferred embodiment, the coefficient decoder 1300 (Fig. 13A) is 
responsible for the subsequent decoding of the encoded coefficients. 

[0093] The basic encoding algorithm relies upon the expected magnitude of coefficients for standard images to ef- 
ficiently encode the coefficients. Turning again to Fig. 1 5, it is assumed for operation of the encoding that the coefficient 
LL2 is likely to be the most significant followed by HL2. LH2, HH2 and then followed by the level 1 coefficients HL1. 
LHIandHHI. 
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[0094] The original coefficient matrix is then as illustrated 1 900 in Fig. 1 9. In the preferred embodiment, it is assumed 
that the coefficients take on 8-bit values in accordance with the example as illustrated in Fig. 18. The encoding meth- 
odology is to sort the coefficients by magnitude and output a zero for each leading zero of the most significant magnitude 
coefficient. Once a 1 value of the binary coefficient is reached, a "1 " value is output followed by the LL2 coefTicient 
5 1 902 is encoded, as it is assumed that this coefficient will always be the most significant. Next, the remaining coefficients 
1904 are sorted in order of magnitude and a 0 is output for each level of leading zeros until no more zeros are left. 
Once this situation is reached, a 1 is output followed by the HL2. LH2 and HH2 coefficients which are split off and 
encoded 1 906 leaving the remaining coefficients 1 908. 

[0095] The remaining coefficients 1908 are then sorted in order of magnitude and a 0 output for each remaining 
10 leading zero before a 1 value is reached. Once this is the case, a 1 is output and the remaining coefficients 1910 are 
encoded. This process of pulling off the lower frequency coefficients is continued, depending on the size of the input 
array until all the coefficients having been encoded and the null matrix is left 1912. 

[0096] In Fig. 20, there is illustrated an example of the operation of the encoding of the 4 x 4 matrix 1800 of Fig. 18. 
Taking this example in detail, the coefficient having the decimal value 33 is initially the most significant coefficient and 

-IS has two leading O's. Therefore, two zeros are output 2000. 2002 for the bit plane levels 8 and 7, Next, the coefficient 
value decimal 33 results in the triggering of the coefficient output 2004, which is output after the outputting of a 1 value. 
[0097] Subsequently, as no other coefficients have as significant binary bits set, a 0 is output 2006 so as to reduce 
the bit plane level number. At this bit plane, the bit plane of decimal value 17 is set which in turn triggers the output of 
a one and a series of coefficients 2008 (corresponding to the coefficients 1 906 of Fig. 1 9), and leaving the coefficients 

20 corresponding to coefficients 1 908 of Fig. 1 9. Subsequently, the next most significant decimal value is the value 4 and 
so a series of zeros is output at steps 2010, 2012 before outputting a one at bit plane level 3 (2014) followed by the 
coefficients 201 6 corresponding to the HLl coefficients of Fig. 1 9. Where a block has more than a single pixel coefficient, 
the algorithm is applied recursively on each of the sets of coefficients, hence, the algorithm is applied recursively on 
the HLl coefficients, the LH1 coefficients and HH1 coefficients. This necessitates the operation of a push down stack 

25 to encode these coefficients. Hence, at the step 201 8 of Fig. 1 9. the current bit plane is again bit plane level 3 and the 
coefficients corresponding to LH1 are examined to determine if any are significant at this bit plane. As this is not the 
case as zero is output 201 8 foltowed by a 1 and the series of coefficients as illustrated 2020. Subsequently, the HH1 
coefficients are independently recursed from bit plane level 3 (2022) and a series of zeros are output 2022, 2024 until 
bit plane 1 is reached where one value is output and the corresponding coefficients 2026. 

30 [0098] As known previously, this encoding system is described in the aforementioned patent specffication and further 
details of its operatton can be found herein in the secfion entitled '1. 4 Encoding Process of Second SWEET Image 
Compression Method", It is however, an object of the preferred embodiment of the present invention to provide for an 
efficient form of decoding a series of previously encoded coefficient data encoding. 

[0099] Turning now to Fig. 21 , there is illustrated one form of suitable arrangement of the coefficients decoder of Fig. 

35 13A. The coefficients decoder takes an input stream 1302 which includes the previously encoded coefficients and 
outputs wavelet coefficients 1304 for feeding to an inverse wavelet transform unit. The input stream 1302 is fed to a 
barrel shifter 2102 that provides for the arbitrary shifting of the input streams. The barrel shifter 2102 includes a shift 
register and acts under the control of a barrel shifter control unit 2104. The output of the barrel shifter is fed to a bit 
stream register 2106 before being fed to a finite state machine 21 08. The finite state machine forms part of a unit 2110. 

^0 which is responsible for monitoring a current bit plane. The finite state machine 2108 acts to control the value withiri 
counter 2112 which keeps the count of a current bit plane number and is decremented when the significance values 
for a bit plane 0. A heap 2114 is also provided for when it is necessary to recurse, when, for example, encoding the 
HLl , LH1 and HH1 coefficients. Hence, it is necessary to provide for the storage of 3 values in heap 2114 for transfer 
to counter 2112 when encoding a new set of subband coefficients. The output of counter 2112 is forwarded to a pixel 

45 generator unit 21 16. The pixel generator 21 16 is responsible for forming output pixel values. The pixel generator accepts 
a number of bits 2118 from the shift register and generates the output wavelet coefficients according to the current bit 
plane level received from counter 2112. For example, if the current bitplane number level is 2 and the input coefficients 
are 11100001 then the following outputs 2120 are produced: 

BO 

1 1 100001 -> 0000001 1 . 00000010, 00000000. 00000001 

[0100] The pixel generator 2116 generates 1. 3 or 4 coefficients at a time, depending on which coefficients are 
generated. 

55 [0101] The finite state machine control unit 2108 keeps count of the current bit plane number and decides whether 
to decrement a counter when the input bit is 0 or release pixels when the input bit is 1. The FSM control unit 2108 
stores the contents of the counter 2112 into the heap 2114 when it is necessary to recurse so as to deal with a set of 
coefficients on a particular level. Further, the FSM control unit loads the counter with the contents of the heap when a 
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branch or recursion is finished. 

[0102] A buffer 2122 is provided for storing the output pixels from the pixel generator 2116 for output to 1306 in 
natural order. 

[0103] The bit stream generator 2106 is responsible for serializing the outputs from the barrel shifter 2102. The 
procedure for decoding a stream of previously encoded coefficients can then include the following steps: 

1. Load the counter 2112 with the maximum number of bits. 

2. Get first bit in the input stream. 

3. If it is 0, decrement the counter 2112. Get next bit and loop back to step 3. 

4. If it is 1 , then the value in the counter 2112 is the number of bits per coefficient in the input stream. Activate the 
pixel generator 2116 to generate pixels. 

5. The pixel generator 2116 takes the required number of bits from the shift register 2102 and pads the most 
significant bits with zeros and outputs then to buffer 2122. After that, the barrel shifter 2102 to shift away those 
data bits. 

6. When the decoding process is required to decode multiple sets of subband coefficients (eg. HL1 , LH1, HH1) 
the contents of the counter 21 1 2 is saved into the heap 21 1 4. Then the first set of subband coefficients are decoded. 

7. After the decoding of one set of subband coefficients, the 21 1 2 is loaded with the value at the top of the heap 21 1 4. 

[0104] Fig. 22 illustrates a flow chart of the preferred method of decoding a bitstream of previously encoded coeffi- 
cients. The preferred method is applied to the bitstream to decode the coefficients for each sub-band in a predetermined 
order. For example, the method preferably decodes the coefficients from the bitsream in the sub-band order LL2, 
HL2,LH2,HH2.HL1,LH1, and HHI as shown in Fig. 15. In step 2200. the process commences and the bitstream is 
inputted. In the next step 2202, a counter n is set to the value MAX_BITPLANE. This value equals the number of bits 
in each decoded coefficient (eg 8 bits). In the next step 2204, the next bit in the bitstream is accessed and the processing 
continues at decision block 2206. In the decision block 2206. a check is made whether the last accessed bit is zero. 
If the decision block 2206 returns Yes(true), then the counter is decremented by one in step 2208 and the processing 
returns to step 2204. If the decision block 2206 returns No(false), then the next n bits are accessed in step 2210 and 
the processing continues at step 221 2. In step 221 2, these n accessed bits are allocated to the least significant bits of 
the current coefficient. As mentioned previously, each coefficient has MAX_BITPLANE bits. In the next step 2214. the 
remaining bits of the current coefficient are padded with zeroes and the processing continues at decision block 2216. 
In decision block 2216, a check is made whether there exists any more coefficients in the current sub-band. If the 
decision block 221 6 returns true(Yes) then the processing continues at step 2210. Otherwise the processing terminates 
at step 2218. After the decoding of one set of subband coefficients, the method can be called again and again until all 
subband coefficients of the blocks are decoded. 

Alternate Embodiment of Apparatus(s ) 

[0105] Whilst the preferred decoder in accordance with the invention is implemented in dedicated hardware, the 
decoding processes can also be practiced using a conventional general-purpose computer, such as the one shown in 
Fig. 8., wherein the processes of Fig. 22 may be implemented as software executing on the computer. In particular, 
the steps of the decoding methods are effected by instructions in the software that are carried out by the computer 
The software may be divided into two separate parts; one part for carrying out the decoding methods; and another part 
to manage the user interface between the latter and the user. The software may be stored in a computer readable 
medium, including the storage devices described below, for example. The software is loaded into the computer from 
the computer readable medium, and then executed by the computer. A computer readable medium having such soft- 
ware or computer program recorded on it is a computer program product. The use of the computer program product 
in the computer preferably effects an advantageous apparatus for decoding coded representations of digital images 
in accordance with the embodiments of the invention. 

[0106] The computer system 800 consists of the computer 802. a video display 81 6, and input devices 818. 820. In 
addition, the computer system 800 can have any of a number of other output devices including line printers, laser 
printers, plotters, and other reproduction devices connected to the computer 802. The computer system 800 can be 
connected to one or more other computers via a communication interface 808c using an appropriate communication 
channel 830 such as a modem communications path, a computer network, or the like. The computer network may 
include a local area network (LAN), a wide area network (WAN), an intranet, and/or the Internet 
[01 07] The computer 802 itself consists of a central processing unit(s) (simply referred to as a processor hereinafter) 
804, a memory 806 which may include random access memory (FIAM) and read-only memory (ROM), input/output 
(lO) interfaces 808a, 808b & 808c, a video interface 810, and one or more storage devices generally represented by 
a block 812 in Fig. 8. The storage device(s) 812 can consist of one or more of the following: a floppy disc, a hard disc 
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drive, a magneto-optical disc drive, CD-ROM, magnetic tape or any other of a number of non-volatile storage devices 
well known to those skilled in the art. Each of the components 804 to 812 is typically connected to one or more of the 
other devices via a bus 814 that in turn can consist of data, address, and control buses. 

[0108] The video interface 810 is connected to the vkdeo display 816 and provides video signals from the computer 
5 802 for display on the video display 81 6. User input to operate the computer 802 can be provided by one or more input 
devices 808b. For example, an operator can use the keyboard 818 and/or a pointing device such as the mouse 820 
to provide input to the computer 802. 

[0109] The system 800 is simply provided for illustrative purposes and other configurations can be employed without 
departing from the scope and spirit of the invention. Exemplary computers on which the embodiment can be practiced 

10 include IBM-PC/ATs or compatibles, one of the Macintosh (TM) family of PCs, Sun Sparcstatran (TM), or the like. The 
foregoing is merely exemplary of the types of computers with which the embodiments of the invention may be practiced. 
Typically, the processes of the embodiments, described hereinafter, are resident as software or a program recorded 
on a hard disk drive (generally depicted as block 812 in Fig. 8) as the computer readable medium, and read and 
controlled using the processor 804. Intermediate storage of the program and pixel data and einy data fetched from the 

IS network may be accomplished using the semiconductor memory 806, possibly in concert with the hard disk drive 812. 
[0110] In some instances, the program may be supplied to the user encoded on a CD-ROM or a floppy disk (both 
generally depicted by block 812), or alternatively could be read by the user from the network via a modem device 
connected to the computer, for example. Stit! further, the software can also be loaded into the computer system 800 
from other computer readable medium including magnetic tape, a ROM or integrated circuit, a magneto-optical disk, 

20 a radio or infra-red transmission channel between the computer and another device, a computer readable card such 
as a PCMCIA card, and the Internet and Intranets including email transmissions and information recorded on websites 
and the like. The foregoing is merely exemplary of relevant computer readable mediums. Other computer readable 
mediums may be practiced without departing from the scope and spirit of the invention. 

[Oil 1] The foregoing only describes a small number of embodiments of the present invention, however, modifications 
25 and/or changes can be made thereto by a person skilled in the art without departing from the scope of the invention. 
The present embodiments are, therefore, to be considered in all respects to be illustrative and not restrictive. 



Claims 

30 

1 . An apparatus for decoding a stream of previously encoded coefficients including: 
input means for receiving said stream of encoded coefficients; 

bit plane level monitoring means connected to said input means and adapted to monitor a current bit plane ^ 
35 level from said stream of coefficients; 

pixel generation means interconnected to said input means and said bit plane level monitoring means and 
adapted to utilize said current bit plane level for generating output coefficient values each having a predeter- 
mined size. 

40 2. An apparatus as claimed in claim 1 , wherein said bit plane level monitoring means includes: 

a finite state control nnachine interconnected to said input means and adapted for determining bit plane level 
changes in said coefficient input stream; 

a counter interconnected to said finite state control machine for monitoring a current bit plane level; 
45 a heap store interconnected to said counter and said finite state control machine and adapted to store bit plane 

level values for utilization in recursion operations by said finite state control machine; 

and wherein said finite state machine acts to decrement said counter upon the receipt of a bit level change 
indicator in said coefficient input stream and further to control the reloading of said counter upon completion 
said recursion operations. 

50 

3. An apparatus as claimed in claim 1 . further including: 

a buffer means interconnected to said pixel generation means for storing said coefficient values for subse- 
quent output in a predetermined order 

55 4. An apparatus as claimed in claim 1 , wherein said input means includes a barrel shifter operated under the control 
of said pixel generation means to excise coefficient value portions from said input stream. 

5. A method of decoding a bitstream of previously encoded coefficients, the method including the following steps: 
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(i) inputting the bitstream of encided coefficients; 

(ir) determining a current brtptanr level of bits within said stream; and 

(iii) generating output coefficient values each having a predetermined number of bits utilizing said current 
bitplane level and bit fragments within said bitstream. 

5 

6. A method as claimed in claim 5, wherein the generating step (iii) includes the following substeps: 

(iii)(a) selecting a number of bits from a bit fragment of the coefficient stream, where said number corresponds 
to the number of the current bitptane; 
1^ (iii)(b) allocating said number of bits to the least significant positions of a said coefficient value; and 

(iii)(c) padding the remainder of the positions of said coefficent value with zeros. 

7. A method as claimed in claim 5, wherein the method includes after step(iii) the following step: 

(iv) eliminating said bit fragments from said bitstream. 

IS 

8. An apparatus for decoding a bitstream of previously encoded coefficients, the apparatus including: 
input means for inputting the bitstream of encoded coefficients; 

determination means for determining a current bitplane level of bits within said stream; and 

generation means for generating output coefficient values each having a predetermined number of bits utilizing 

said current bitplane level and bit fragments within said bitstream. 

9. A method as claimed in claim 8, wherein the generation means includes: 

2^ selection means for selecting a number of bits from a bit fragment of the coefficient stream, where said number 

corresponds to the number of the current bitplane; 

allocation means for allocating said number of bits to the least significant positions of a said coefficient value; 
and 

padding means for padding the remainder of the positions of said coefficent value with zeros. 

30 

10. An apparatus as claimed in claim 8, wherein the apparatus includes: elimination means for eliminating said bit 
fragments from said bitstream. 

1 1 . A computer program product including a computer readable medium having recorded thereon a computer program 
3S for decoding a bitstream of previously encoded coefficients, the computer program product including: 

input means for inputting the bitstream of encoded coefficients; 

determination means for determining a current bitplane level of bits within said stream; and 
generation means for generating output coefficient values each having a predetermined number of bits utilizing 
"^0 said current bitplane level and bit fragments within said bitstream. 

12. A computer program product as claimed in claim 11 , wherein the generation means includes selection means for 
selecting a number of bits from a bit fragment of the coefficient stream, where said number corresponds to the 
number of the current bitplane; 

45 

allocation means for allocating said number of bits to the least significant positions of a said coefficient value; 
and 

padding means for padding the remainder of the positions of said coefficent value with zeros. 

so 13. A computer program product as claimed in claim 11, wherein the product includes: 
elimination means for eliminating said bit fragments from said bitstream. 
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stream of previously encoded coefficients including in- 
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cients; bit plane level monitoring means connected to 
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the current bit plane level for generating output coeffi- 
cient values each having a predetermined size. The bit 
plane level monitoring means can include a finite state 
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adapted for determining bit plane level changes in the 
coefficient input stream; a counter interconnected to the 
finite state control machine for monitoring a current bit 
plane level; a heap store interconnected to the counter 
and the finite state control machine and adapted store 
bit plane level values for utilization in recursion opera- 
tions by the finite state control machine; and wherein the 
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the receipt of a bit level change indicator in the coeffi- 
cient input stream and further to control the reloading of 
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